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Turbo decoding using the MAP algorithm 
Part 2 — A Step by step example 
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Figure 1 — A rate 1/3 PCCC Turbo code 


In this example, we will use a rate 1/3 Turbo Code which has two identical 
convolutional codes. Note that since y;" is a deterministically reshuffle version of 
y,*, it is not transmitted. The second decoder is given y;,*, and it then de-interleaves it 


to get its copy of y;* which it needs for decoding. 


The coding trellis for each is given by the figure below. The blue lines show 
transitions in response to a O and red lines in response to a 1. The notation 1/11, the 
first number is the input bit, the next are two code bits. Of these, the first is what we 
called the systematic bit, and as you can see, it is same as the input bit. The second 
bit is the parity bit. Each code uses this trellis for encoding. 
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Figure 2 — the trellis diagram of the rate 1/2 code RSC code 


For the example, we pick the information bit sequence: 1, 0, 1, 0, 1, 0, 0, which in 
bi-polar form is shown in Table 1. Code | encodes each of these bits as systematic 
and parity bits using the trellis in Fig. 7. The bits are coded in a bipolar format. 


Table 1 — Coded bits through first Encoder 
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The sequence looks like this on the trellis diagram. 


Figure 3 — Trellis diagram for information (1, -1, 1, -1, 1, -1, -1) through first 
encoder 


The code 2 receives the same information bits but interleaved by a given pattern. 
Interleaving is an important issue in turbo coding. There are several different types of 
interleaving patterns other than the row column method you know. Here I have made 
up a “pseudo-random” interleaving pattern shown in Table 2. The deinterleaving 
pattern puts the bits back in the original order. Simulations shows that pseudorandom 
interleaving works best with turbo codes in AWGN channel. 


Table 2 — Interleaving patter from Encoder 1 to Encoder 2 and then 
deinterleaving back to Encoder 1 from Encoder 2 
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After reordering the information sequence (1, -1, 1, -1, 1, -1, -1) into (1, 1, 1, -1, - 
1, -1, -1) Encoder 2 codes the new sequence as in Table 3. 


Table 3 — Interleaved bits coded by Encoder 2 


Systematic 


Parity bit, ENC2 


Figure 4 — Trellis diagram for information (1, 1, 1, -1, -1, -1, -1) through 
second encoder 


Note that the systematic bits from Code 2 are redundant and will not be 
transmitted. This gives us a rate 1/3 code if you don’t count the tail bits. The 
transmitted data is given incolumns or: 111 -11-1 1-11... 


Table 4 — Transmitted data, one systematic bit and two parity bits from each 
encoder 
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That’s all for the encoding. On the receiving end, assume that this signal goes 
through a AWGN channel with signal Es/NO = 0.25, which is quite small. A bunch of 
errors popup and the received data with some channel gain is received as shown in 
Table 5. 


Table 5 — Received signal amplitudes (soft data) 


Sterna a | a SE 


Pyotr tt >)if2)[f+z;, 2 | 1 | 2 | 1 | 
Payee \S7 TX 127) 2 | 3s | 35 7 6 
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These values are called soft inputs. Although the above are integers, they don’t 
have to be. I happen to pick integers for this example. 


We have total of four errors. One in the systematic bits and three in parity bits. 


Unlike Viterbi and other codes, in MAP algorithm channel SNR effects decoding and 
it does that by exaggerating the effect of the systematic bits. So if there is an error in the 
systematic bit, it also gets exaggerated. In Table 5, I have assumed that the second 
systematic bits is in error, as well as the first and fourth parity bits. The term L, is the 
measure of the signal SNR. 


L, = 4 Es/NO = 4 x 0.25 = 1.0 


Multiply the received signal by L, which is defined above and is equal to 1.0 for 
this example. L, is indicates the condition of the channel. High is good. 


Table 6 — Input signal level multiplied by channel L, 


al 


Decoding 


For each time tick k, decoding is done by calculating the L-values of a +1 bit. If it 
is positive, the decision is in favor of a +1. Calculation of the L-values or L(ux) is 
quite a complex process. The main equation used to calculate the L-value is this. 


| | Yi &465)- B69) -7E (8,8) 
L(u,) =|L’ (u,) + Le: yp* |+ log — ~ 
‘ ‘ ; YG1(5') B, (9) 7565.8) 

u (1) 


From this computation if L(ux) is positive, then ux is equal to +1. 


The first term, L’(u,) is the a-priori value from Decoder 2. This is the L-value of 
the a-priori probability of the bit in question. At first, the decoder has no idea what it 
is. A good guess is to assume it is 0.5. The second term, L,y;* is computed by 
multiplying the systematic information with L, as in Table 6. This value is the 
channel L-value and gives an indication of channel SNR. The third big term with all 
kinds of squiggly items is the a-posteriori probability. This number is calculated for 
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each trellis segment. Remember that we can only have one result for a trellis section, 
a +1 or -1. The L(u,) calculation tells us what that number is, 


The big equation can be written simply as sum of three pieces of information. 
L-apriori — This is our initial guess about a +1 bit in first iteration 


L-Channel - This is related to channel SNR and systematic bit and is equal to 
Lgeye 


L, — the computed information in each iteration is called the a-posteriori L-value. 


Eq. | can be now written as the sum of these as 


=L_apriori+ L_channel+ L'(u,) 


(2) 


The L-channel value does not change from iteration to iteration since is it given 
by L_channel = Ly; . Neither the L, nor the systematic bit changes from iteration to 


iteration, So lets called it K. The only two items that change are the a-priori and a- 
posteriori L-values. 


L(u,) = L_apriori + K + L_ posteriori 


A-priori value goes in, it is used to compute the new a-posteriori probability and 
then it can be used to compute L(u,) or is passed to the next decoder. Although in the 
example we compute L(ux) each time, during actual decoding this is not done. Only a- 
posteriori metric is computed and decoders and keep doing this either a fixed number 
of times or until it converges. L-posteriori is also called Extrinsic information. 


Iteration | 


L(uy)=0+K, +L, 
Ly (Uy) = “ATK, + Li 


Iteration2 


Lu.) = L,3 + Ki th 


L,(u,) = Dy +K,+ T59 


Iteration 3 


(uz) = £55 eet 


Ly (Uy) = Ly) +K, +13, 


So the whole objective for the calculations is to compute the extrinsic L-value, keep an eye 
on them and when they get big, then compute L(uk) and make a decision. The computation 
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of these L-values uses an algorithm called Forward-Backward Recursion and this is of course 
another name for BCJR and many others. 


In equation, we have three terms in the ratio that need to be computed. They are 
G(s"): B,(s)-7£(s',5) 


The first term is called the forward metric. It is computed by a forward recursion using the 
last term called branch metrics. It is given by 


ay = Vals") % (s',s) 


This is a recursive process. The forward branch metric is the product of previous forward 
metric times the branch metric. (The reason we call these metrics is that these are not really 
probabilities in a strict sense, just a measure of probability.) So to compute the forward 
metric, we first need to compute branch metrics. 


In real situations, if the block is 10,000 bits long, then we would need to compute these 
metrics for 10000 times the number of states times 2. The example here has just 7 bits. It has 
4 states so we will do this 7 x 4 x 2 = 56 times. 


A branch metric is the correlation of the received signal with its trellis values. In a nutshell, if 
the received values are the same sign as the coded bits, then the correlation will be high. For 
each decoder, there are full transition branch metrics which incorporate, the systematic and 
the parity bits and partial branch metrics which incorporate only the parity bits. 


ae 


ls Lp .2,p 
Ve oVE NE 
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Figure 5 — Iteration cycle of MAP Turbo Decoding 
1. Computing full branch metrics 


The full branch metric is given by the equation 


M apts 1 ois - I spe 8 
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The data required is L., the systematic value, parity value and trellis coded values. 
We compute this for each branch of the trellis for all seven time ticks. 


Example: For branch 1-1 (from state to statel), k = 1, 
yi! = 2, yf? =-5, Le = 0 


What is L, and why is it zero? L, is our initial L-value. In the start, we do not 
know if the encountered bit was a 0 or a 1, so we assume that the probability of a 0 is 
equal to a probability of 1. The L-value is given by 


Pu, = +1) 


L(tu,) = In Plu, = 1) 


If 0 and 1 are equally likely, a safe bet, the then log of 1.0 is zero. And that is 
what L, is. It is the initial value of the Extrinsic L-value. The Extrinsic L-value is the 
key information that the decoders share. It works something like this. 


ls lp 
Ve Nk 


Ly) (uy) =0 
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Figure 6 — Feedback nature of the Extrinsic, value. The value produced 
by each decoder] (Z;,(u,) ) becomes the input for the next decoder. 


This thing — Extrinsic L-value is what goes around from one code to the next, It is 
also called the a-posteriori probability at the output of a decoder and becomes the 
apriori probability for the next decoder in a feedback manner going round and round 
and getting larger each iteration.. Nice thing about L-values is that large means better 
reliability. 


Computing Full branch metrics requires five inputs, shown in columns 1-5 below. 
Branch value is calculated using the equation 


Table 7 — Computing Full branch metrics 
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a a 


2. Compute partial branch metrics 


These values are based only on parity bits. It is last part in Eq. 1. We will use 
these to compute the total extrinsic L-values. 


The equation for calculating the partial metrics is given by 


4 lo... 
(69) A exe} Y[ Led" 3) 
i=2 


Note that there is nothing here that changes from iteration to iteration, so these 
only need to be computed once. 


Table 9 — Partial branch metrics stay constant for each decoder 


= 
(02) 


y* (3,2) 
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Figure 7 - Partial branch metrics on the trellis 


Calculation of forward metrics 


Encoding always starts in state 1. So we assume that signal can only be in state 1 
at time k =0. The initial value of the forward metric is set at 1.0. The other three states 
are given value of 0.0. Meaning, these are not possible states. Thereafter the forward 
metrics are computed recursively for each state (not branches). 


The equation is 
Ye O S's) (4) 


PRIMA 


a@,(s) = 


Computation of forward metrics will be done in two steps, first we will compute 
the numerator at time k, then we will compute the denominator. 


1 1. —44817 _. 4.4817 dcteicvin Smt 
’ oT (.9526) 


“2931 


SM Oh eee ee . i 
33.1155 : ) 


Figure 8 — Computing forward metric 
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We will compute the forward metric at state 3, k = 1 and then at state 2, k =2. 
Here is how you think about this. There are two branches converging into state 3 at 
time k =1. Each of these brings its full branch metric to bear on the converging state. 
Computation involves multiplying the branch metrics with the starting state value and 
then summing these for all converging branches at the state in question. This is two 
branches. We do this for each state based on the specific branches that are coming 
into it. We can think of as the amount of traffic these roads are bringing to the 
intersection. 


We compute the forward state metric at state 3 as 

a;= 1.0 x 0.2231 + 0.0 x 4.4817 = 0.2231 

The only other non-zero forward metric at this point is state 1, which is 
a, = 1.0 x 4.4817 + 0.0 x 0.2231 = 4.4817 


Before we continue on to k = 2, we need to normalize these values, which is 
denominator in Eq . The purpose of normalization is to control the numerical 
overflow which may occur due to the large number of numbers that are being 
multiplied together. Before we proceed, we normalize the values at each time. This 
gives them more of a flavor of probabilities and makes it easier to understand and 
reduces the numerical overload. 


To normalize, we use the sum of forward metrics which is 4.7048. Normalizing 
the two metrics with this sum, gives us the two values in col 3, Table. 


Now to move forward to state 2, it has two branches (from s3 and from s4) 
converging into it. Its forward metric is calculated by 


a; = 0.0474 x 0.6065 + 0.0 x 0.0302 = 0.0288 


We compute these for all four states and we get the following values. The column 
is the added to compute the normalizing sum. It is then used in Table to normalize all 
forward metrics. 


Table 10 — Computation of forward metrics 


Table 11 — Normalized forward state metrics 
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@@) af 0.0177] 0.3171 0.0739] 0.0489] 0.0442] 
2G) foi] 9.0018] 0.0156] 0.0535] 0.3872 0.1362] 0.0593] 
ea 7297] 524] O3ITIY 1462] 0.1002] 0.0595] 


3. Computing backward state metrics 


AO AGH) 


BACs) = Ta. (s',s) . 


Ss 


We assume that the signal will end in state 1. (Tail bits are added to force it end in 
state 1.) The ending state is always s1, so it gets a value of 1.0 just as the forward 
state metric. The rest of the three states at k = 7 are given a backward state value of 
zero. Look at how these propagate backwards. 


VA ls',9) 


We will compute the backward state metric at state 3. There are two branches 
coming into state s3 at k = 5. So we will compute their backward metrics first. For 
state s2, it has two branches coming into it, 2-1 and 2-3. 


Bb; = 1.0 x 0.0498 + 0.0 x 1.6487 = 0.0498 


B+ =0 (It has two branches coming into it but both have starting backward 
metrics of 0 so, it is zero as well.) 


1.0 sl 
0033 a 
( 0498) .6065 : 
fc QO s 
0005 
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k k+1 k+2 


Figure 9 — Computing backward state metrics 


Compute all four as shown at k = 7. Now again, we normalize. But we normalize 
with the same set of numbers as the forward metrics so they are both on the same 
footing. Divide each backward state metric after computation and normalize before 
proceeding to the next time tick. 
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Table 12 —Backward state metrics 


BQ) 1 768f 3.4108] 0.2180] 43.1318] 0.0906] o.oagg| 
Bay 14 3680f 0.5916] 15.7811] 0.0413] 0.001659] 0.0000] 
Bay 7.4396f 18.4184] 15.7811] 0.0198] 0.0123) o.0000f 


Table 13 —Normalized Backward state metrics 


Boy | 0277] 1.109] 0.034] 15.7739] 0.0239] 0.0045] 


Za) 0.4335f 0.2621] 2.4920] 0.01sif 0.0004] | 
cay) 0.2245f 8.1588] 2.4920] 0.0072 0.0032] | 


4. Computing Extrinsic L-values 


Now we will compute the Extrinsic L-value. Which are given by the product of 
the all three metrics. 


oS) = G(s") 7E(s',8)- BCs) 


This is multiplication of the forward, backward the_partial branch metric for each 
branch. We get one value for each branch, or eight values per time as shown below. 


Table 14 — Computation of final branch metrics 


om | ooo] ooo] ooooi] ore] maz] ism iim|_——sniam UD) fay 
o@ [| 0000] 0000] 11029] 0.0007] o.000i| 0.0000] 0.0000] 23, @@yr 2.31 f(2)_ 


oa) ___] S280] o.000e] 0.0001] .0006| 0.0002] 0.0000] o.0000 1a] @0) ts) pay | 
oy | 0.0000] .0000] __o.14oq] _o.0osi| __s.cais] __o.oss| oo 21] @2)r"(2) poy | 
eG) | 0.0000] 03553 o.00oi| 0.6703 0.0008] 0.0047] 0.0000) 321 (5) 7°(3.2) BG) | 


1.00 
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Figure 10 — Forward and backward state metrics for the trellis 


To compute the L-value we need the ratio of these numbers for the +1 and -1 
branches. For that we add the top four branch metrics and divide by the sum of the 
bottom four branch metrics to satisfy the following equation 


Ya (8) BS) 74 (8',5) 


log ut _ : 
VGH) Bel) 7{(8',) 


Take the natural log of the ratio. This is the extrinsic value output for this 
iteration. These values after interleaving go to Decoder 2 and become it’s a-priori 
probabilities. 


Normally the decoder at this point would stop because it has done its job of 
computing the extrinsic value. But I will compute the L-value of the bit to show you 
how the bit decisions can be made at any iteration. 


The L-value of the bit is given by 
=L_apriori+ L_channel+ L'(u,) 
At each iteration, we have all three of these as shown in Table 17. 


Table 15 — Computing L(u,) and making a decision 


L(extrinsic) 7.035 -3.685 1.032 -2.013 1.009 -3.579 -3.682 
L(uk) 9.035 -2.685 4.032 -4.013 3.009 -7.579 -8.682 
Decision 1 0 1 0 1 0 0 
Transmitted 1 0 1 0 1 0 0 


Notice that we make independent decisions in each time tick, with no regard to 
the trellis, so that makes this algorithm a bit error rate minimization algorithm, where 
in Viterbi decoding the decision is made at the sequence level, so that makes it a 
sequence error minimization algorithm. 


From here the L, interleaved numbers go to the DEC2 as follows. 
Table 16 — Transfer of a-posteriori to DEC2 from DEC1 


A 


Le ra -—_s_| _+_}| 2 _) 2 + —_ 


ae 


The L, values for this decoder are no longer 0 as they were for DEC1. They are 
now giving a hint as to what was transmitted. So far the relationship is not clear, but 
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as iterations continue these values become more stable and hopefully have the same 
sign as the transmitted bit. 


Here are all the tables giving pertinent information for the four iterations. The 
code makes errors in earlier iterations but then converges to the correct value. Only 
the first iteration is independent, after that each iteration is modifying the other 
slowly. The extrinsic values do converge as we can see in the plot of these value for 
each decoder for k= 1 tok = 4. 


Table 17 — Summary of decisions after 4 iterations 


eatin _——~+4_ 1 ito | 1 | 0 | 1) 0 | 01 
lteration2 ‘|| 1 | 0 | 1 [0 | 1 [0 | 0] 
Iteration3 —+|| 1 [0 |~1~| 0 | 10 | 0 | 
terationd | 41 | o | 1 | 0 | 1 [0 | 0] 


ftetint _——*+dt 1 fi 71 | 0 | 0 | 0 | 0 
lteration2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 
fteration 3 | 1 | 1 | 1 | 0 | 0} 0 | 0 _] 
lteration@ | 4 [| 1 | 1 | 0 [| 0 | 0 | 0 


The L-values that are passed back and forth are shown in table 20. 


Table 18 — Extrinsic output and L(uk) after four iterations 
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Figure 11 — Extrinsic values over 4 iterations, for DEC1 and DEC2 


Charan Langton 
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